Security screening metrics for information-sharing partnerships.

Recent history has shown both the benefits and risks of information sharing among firms. Information is shared to facilitate mutual business objectives. However, information sharing can also introduce security-related concerns that could expose the firm to a breach of privacy, with significant economic, reputational, and safety implications. It is imperative for organizations to leverage available information to evaluate security related to information sharing when evaluating current and potential information-sharing partnerships. The "fine print" or privacy policies of firms can provide a signal of security across a wide variety of firms being considered for new and continued information-sharing partnerships. In this article, we develop a methodology to gauge and benchmark information security policies in the partner-selection process that can help direct risk-based investments in information sharing security. We develop a methodology to collect and interpret firm privacy policies, evaluate characteristics of those policies by leveraging natural language processing metrics and developing benchmarking metrics, and understand how those characteristics relate to one another in information-sharing partnership situations. We demonstrate the methodology on 500 high-revenue firms. The methodology and managerial insights will be of interest to risk managers, information security professionals, and individuals forming information sharing agreements across industries.

Decision-first modeling should guide decision making for emerging risks.

An emerging risk is characterized by scant published data, rapidly changing information, and an absence of existing models that can be directly used for prediction. Analysis may be further complicated by quickly evolving decision-maker priorities and the potential need to make decisions quickly as new information comes available. To provide a forum to discuss these challenges, a virtual conference, "Decision Making for Emerging Risks," was held on June 22-23, 2021, sponsored jointly by the Decision Analysis Society of the Institute for Operations Research and the Management Sciences and the Decision Analysis and Risk specialty group in the Society for Risk Analysis. Speakers reflected on the work to support decision-makers related to the COVID-19 pandemic as well as experiences in emerging risks across domains from cybersecurity, infrastructure, transportation, energy, food safety, national security, and climate change. Here, we distill the key findings to propose a set of best practice principles for a "decision-first" approach for emerging risks. These discussions underscore the importance of scoping the decision context and the shared responsibility for the development and implementation of the analysis between the analyst and the decision-maker when the context can evolve rapidly. Emerging risks may also favor simpler analytical approaches that increase transparency, ease of explanation, and ability to conduct new analyses quickly. Continued dialogue by the decision and risk analysis communities on the use and development of models for emerging risks will enhance the credibility and usefulness of these approaches.

Can Comorbidity Data Explain Cross-State and Cross-National Difference in COVID-19 Death Rates?

Many efforts to predict the impact of COVID-19 on hospitalization, intensive care unit (ICU) utilization, and mortality rely on age and comorbidities. These predictions are foundational to learning, policymaking, and planning for the pandemic, and therefore understanding the relationship between age, comorbidities, and health outcomes is critical to assessing and managing public health risks. From a US government database of 1.4 million patient records collected in May 2020, we extracted the relationships between age and number of comorbidities at the individual level to predict the likelihood of hospitalization, admission to intensive care, and death. We then applied the relationships to each US state and a selection of different countries in order to see whether they predicted observed outcome rates. We found that age and comorbidity data within these geographical regions do not explain much of the international or within-country variation in hospitalization, ICU admission, or death. Identifying alternative explanations for the limited predictive power of comorbidities and age at the population level should be considered for future research.

Multicriteria Decision Framework for Cybersecurity Risk Assessment and Management.

Risk assessors and managers face many difficult challenges related to novel cyber systems. Among these challenges are the constantly changing nature of cyber systems caused by technical advances, their distribution across the physical, information, and sociocognitive domains, and the complex network structures often including thousands of nodes. Here, we review probabilistic and risk-based decision-making techniques applied to cyber systems and conclude that existing approaches typically do not address all components of the risk assessment triplet (threat, vulnerability, consequence) and lack the ability to integrate across multiple domains of cyber systems to provide guidance for enhancing cybersecurity. We present a decision-analysis-based approach that quantifies threat, vulnerability, and consequences through a set of criteria designed to assess the overall utility of cybersecurity management alternatives. The proposed framework bridges the gap between risk assessment and risk management, allowing an analyst to ensure a structured and transparent process of selecting risk management alternatives. The use of this technique is illustrated for a hypothetical, but realistic, case study exemplifying the process of evaluating and ranking five cybersecurity enhancement strategies. The approach presented does not necessarily eliminate biases and subjectivity necessary for selecting countermeasures, but provides justifiable methods for selecting risk management actions consistent with stakeholder and decisionmaker values and technical data.

Assessing nanomaterial exposures in aquatic ecotoxicological testing: Framework and case studies based on dispersion and dissolution.

The unique behavior of engineered nanomaterials (ENM) in aqueous media and dynamic changes in particle settling, agglomeration and dissolution rates is a challenge to the consistency, reliability and interpretation of standard aquatic hazard bioassay results. While the toxicological endpoints (e.g., survival, growth, reproduction, etc.) in ecotoxicity bioassays are largely applicable to ENMs, the standard methods as written for dissolved substances are confounded by the dynamic settling, agglomeration and dissolution of particulate ENMs during the bioassay. A testing framework was designed to serve as a starting point to identify approaches for the consistent conduct of aquatic hazard tests that account for the behavior of ENMs in test media and suitable data collection to support representative exposure metrology. The framework was demonstrated by conducting three case studies testing ENMs with functionally distinct characteristics and behaviors. Pretests with a temporal sampling of particle concentration, agglomeration and dissolution were conducted on each ENM in test media. Results indicated that a silver nanoparticle (AgNP) powder was not dispersible, a nano-TiO2 powder was dispersible but unstable, and a polyvinylpyrrolidinone-coated AgNP was relatively stable in test media. Based on these functional results, Ceriodaphnia dubia bioassays were conducted to compare different exposure summary methods (nominal, arithmetic average, geometric average, time-weighted average) for calculating and expressing toxicity endpoints. Results indicated that while arithmetic means were effective for expressing the toxicity of more stable materials, time-weighted averaged concentrations were appropriate for the unstable nano-TiO2.

Selection of invasive wild pig countermeasures using multicriteria decision analysis.

Wild pigs are a widespread invasive species that pose significant environmental and social risks. A number of wild pig eradication and control measures exist, but many eradication campaigns are ultimately unsuccessful. Decision making regarding how to design and execute an eradication plan is difficult because of multiple costs and benefits spanning various decision criteria that are associated with different eradication and control countermeasures. Moreover, multiple stakeholders are often involved with differing and sometimes competing objectives, and wild pigs are adaptive adversaries, meaning that the ideal countermeasure may change over time. In this paper, we propose the use of formal decision analytic tools which can structure decision problems into a set of relevant criteria, countermeasures, and stakeholder preferences to facilitate the evaluation of tradeoffs. We operationalize this method in a simple Excel-based decision tool and conclude with a path forward regarding how to successfully implement such tools for effective wild pig control.

Traceability and Risk Analysis Strategies for Addressing Counterfeit Electronics in Supply Chains for Complex Systems.

Within the microelectronics industry, there is a growing concern regarding the introduction of counterfeit electronic parts into the supply chain. Even though this problem is widespread, there have been limited attempts to implement risk-based approaches for testing and supply chain management. Supply chain risk management tends to focus on the highly visible disruptions of the supply chain instead of the covert entrance of counterfeits; thus counterfeit risk is difficult to mitigate. This article provides an overview of the complexities of the electronics supply chain, and highlights some gaps in risk assessment practices. In particular, this article calls for enhanced traceability capabilities to track and trace parts at risk through various stages of the supply chain. Placing the focus on risk-informed decision making through the following strategies is needed, including prioritization of high-risk parts, moving beyond certificates of conformance, incentivizing best supply chain management practices, adoption of industry standards, and design and management for supply chain resilience.

A weight of evidence assessment approach for adverse outcome pathways.

The adverse outcome pathway (AOP) is a framework to mechanistically link molecular initiating events to adverse biological outcomes. From a regulatory perspective, it is of crucial importance to determine the confidence for the AOP in question as well as the quality of data available in supporting this evaluation. A weight of evidence approach has been proposed for this task, but many of the existing frameworks for weight of evidence evaluation are qualitative and there is not clear guidance regarding how weight of evidence should be calculated for an AOP. In this paper we advocate the use of a subject matter expertise driven approach for weight of evidence evaluation based on criteria and metrics related to data quality and the strength of causal linkages between key events. As a demonstration, we notionally determine weight of evidence scores for two AOPs: Non-competitive ionotropic GABA receptor antagonism leading to epileptic seizures, and Antagonist-binding and stabilization of a co-repressor to the peroxisome proliferator-activated receptor α (PPARα) signaling complex ultimately causing starvation-like weight loss.

Limitations of toxicity characterization in life cycle assessment: Can adverse outcome pathways provide a new foundation?

Life cycle assessment (LCA) has considerable merit for holistic evaluation of product planning, development, production, and disposal, with the inherent benefit of providing a forecast of potential health and environmental impacts. However, a technical review of current life cycle impact assessment (LCIA) methods revealed limitations within the biological effects assessment protocols, including: simplistic assessment approaches and models; an inability to integrate emerging types of toxicity data; a reliance on linear impact assessment models; a lack of methods to mitigate uncertainty; and no explicit consideration of effects in species of concern. The purpose of the current study is to demonstrate that a new concept in toxicological and regulatory assessment, the adverse outcome pathway (AOP), has many useful attributes of potential use to ameliorate many of these problems, to expand data utility and model robustness, and to enable more accurate and defensible biological effects assessments within LCIA. Background, context, and examples have been provided to demonstrate these potential benefits. We additionally propose that these benefits can be most effectively realized through development of quantitative AOPs (qAOPs) crafted to meet the needs of the LCIA framework. As a means to stimulate qAOP research and development in support of LCIA, we propose 3 conceptual classes of qAOP, each with unique inherent attributes for supporting LCIA: 1) mechanistic, including computational toxicology models; 2) probabilistic, including Bayesian networks and supervised machine learning models; and 3) weight of evidence, including models built using decision-analytic methods. Overall, we have highlighted a number of potential applications of qAOPs that can refine and add value to LCIA. As the AOP concept and support framework matures, we see the potential for qAOPs to serve a foundational role for next-generation effects characterization within LCIA. Integr Environ Assess Manag 2016;12:580-590. Published 2015. This article is a US Government work and is in the public domain in the USA.

Data-Driven Method to Estimate Nonlinear Chemical Equivalence.

There is great need to express the impacts of chemicals found in the environment in terms of effects from alternative chemicals of interest. Methods currently employed in fields such as life-cycle assessment, risk assessment, mixtures toxicology, and pharmacology rely mostly on heuristic arguments to justify the use of linear relationships in the construction of "equivalency factors," which aim to model these concentration-concentration correlations. However, the use of linear models, even at low concentrations, oversimplifies the nonlinear nature of the concentration-response curve, therefore introducing error into calculations involving these factors. We address this problem by reporting a method to determine a concentration-concentration relationship between two chemicals based on the full extent of experimentally derived concentration-response curves. Although this method can be easily generalized, we develop and illustrate it from the perspective of toxicology, in which we provide equations relating the sigmoid and non-monotone, or "biphasic," responses typical of the field. The resulting concentration-concentration relationships are manifestly nonlinear for nearly any chemical level, even at the very low concentrations common to environmental measurements. We demonstrate the method using real-world examples of toxicological data which may exhibit sigmoid and biphasic mortality curves. Finally, we use our models to calculate equivalency factors, and show that traditional results are recovered only when the concentration-response curves are "parallel," which has been noted before, but we make formal here by providing mathematical conditions on the validity of this approach.

Strategies for Selecting Routes through Real-World Environments: Relative Topography, Initial Route Straightness, and Cardinal Direction.

Previous research has demonstrated that route planners use several reliable strategies for selecting between alternate routes. Strategies include selecting straight rather than winding routes leaving an origin, selecting generally south- rather than north-going routes, and selecting routes that avoid traversal of complex topography. The contribution of this paper is characterizing the relative influence and potential interactions of these strategies. We also examine whether individual differences would predict any strategy reliance. Results showed evidence for independent and additive influences of all three strategies, with a strong influence of topography and initial segment straightness, and relatively weak influence of cardinal direction. Additively, routes were also disproportionately selected when they traversed relatively flat regions, had relatively straight initial segments, and went generally south rather than north. Two individual differences, extraversion and sense of direction, predicted the extent of some effects. Under real-world conditions navigators indeed consider a route's initial straightness, cardinal direction, and topography, but these cues differ in relative influence and vary in their application across individuals.

Stakeholder engagement in dredged material management decisions.

Dredging and disposal issues often become controversial with local stakeholders because of their competing interests. These interests tend to manifest themselves in stakeholders holding onto entrenched positions, and deadlock can result without a methodology to move the stakeholder group past the status quo. However, these situations can be represented as multi-stakeholder, multi-criteria decision problems. In this paper, we describe a case study in which multi-criteria decision analysis was implemented in a multi-stakeholder setting in order to generate recommendations on dredged material placement for Long Island Sound's Dredged Material Management Plan. A working-group of representatives from various stakeholder organizations was formed and consulted to help prioritize sediment placement sites for each dredging center in the region by collaboratively building a multi-criteria decision model. The resulting model framed the problem as several alternatives, criteria, sub-criteria, and metrics relevant to stakeholder interests in the Long Island Sound region. An elicitation of values, represented as criteria weights, was then conducted. Results show that in general, stakeholders tended to agree that all criteria were at least somewhat important, and on average there was strong agreement on the order of preferences among the diverse groups of stakeholders. By developing the decision model iteratively with stakeholders as a group and soliciting their preferences, the process sought to increase stakeholder involvement at the front-end of the prioritization process and lead to increased knowledge and consensus regarding the importance of site-specific criteria.

Uncertainty in multi-media fate and transport models: a case study for TNT life cycle assessment.

Life cycle assessment (LCA) is an evaluation method used by decision-makers to help assess the relative environmental impacts of various industrial processes. Despite that many LCA methods remain sensitive to uncertain input data, which can reduce the utility of their results, uncertainty arising from constituent LCA models remains poorly understood. Here, we begin to address this problem by evaluating the extent to which parameter-value uncertainty affects the SimpleBox 2.0 fate and transport model, which serves as a backbone for many LCA ecotoxicological impact categories. Two Monte Carlo type sampling methods were used to evaluate dispersion in steady-state concentration values for three chemicals involved in grenade production: toluene, 2,4-dinitrotoluene (2,4-DNT), and 2,4,6-trinitrotoluene (TNT). Parameters were first sampled stochastically one-at-a-time, then by randomly exploring a local patch of the parameter space. We confirmed that global temperatures contribute primarily to the overall variance of model results, which at most spanned approximately 8 decades in magnitude. These results are consistent with previous results obtained for the whole of the LCA method. LCA methods carry out calculations iteratively; a reduction in the error of a single component, such as the fate and transport model, may therefore improve its performance and utility as a decision-making aid.

A decision analytic approach to exposure-based chemical prioritization.

The manufacture of novel synthetic chemicals has increased in volume and variety, but often the environmental and health risks are not fully understood in terms of toxicity and, in particular, exposure. While efforts to assess risks have generally been effective when sufficient data are available, the hazard and exposure data necessary to assess risks adequately are unavailable for the vast majority of chemicals in commerce. The US Environmental Protection Agency has initiated the ExpoCast Program to develop tools for rapid chemical evaluation based on potential for exposure. In this context, a model is presented in which chemicals are evaluated based on inherent chemical properties and behaviorally-based usage characteristics over the chemical's life cycle. These criteria are assessed and integrated within a decision analytic framework, facilitating rapid assessment and prioritization for future targeted testing and systems modeling. A case study outlines the prioritization process using 51 chemicals. The results show a preliminary relative ranking of chemicals based on exposure potential. The strength of this approach is the ability to integrate relevant statistical and mechanistic data with expert judgment, allowing for an initial tier assessment that can further inform targeted testing and risk management strategies.